Israeli Defense Forces structured-interview reform
Thinking, Fast and SlowThe Israeli Defense Forces structured-interview reform was a pioneering attempt to make military selection more predictive by separating the collection of evidence from the final judgment. Designed in 1955 by a twenty-one-year-old lieutenant who had been assigned responsibility for the army’s entire interview system, it transformed a loose personality interview into a standardized procedure based on factual questions, separate trait ratings, and a fixed scoring formula. Its decisive lesson was not that intuition should be discarded, but that intuition becomes more reliable when it follows disciplined measurement rather than replacing it.
Background and the Problem of Intuition
In 1955, the Israeli Defense Forces was only seven years old, and many of its institutions were still being built. The young lieutenant responsible for redesigning the interview system had a bachelor’s degree in psychology and was probably the best-trained psychologist in the army, even though his direct supervisor held a degree in chemistry. The unusual assignment reflected the circumstances of a young state whose administrative structures were still under construction: someone had to create the system, and the available expert was a very inexperienced officer.
An interview routine already existed. Every drafted soldier completed a battery of psychometric tests, while recruits considered for combat duty underwent a personality interview. The interview was meant to produce a general fitness score and to identify the branch whose demands best matched the recruit’s personality, whether infantry, artillery, armor, or another unit. The interviewers were themselves young conscripts, chosen for intelligence and an interest in dealing with people. Most were women, who were then exempt from combat duty. After only a few weeks of training, they conducted interviews lasting fifteen to twenty minutes, covered a range of topics, and formed a broad impression of how well each recruit might perform in military life.
Follow-up evaluations had already shown that this procedure was almost useless at predicting future success. The reformer was ordered to design a more useful interview without increasing its duration and to test the accuracy of the replacement. He later described himself as scarcely more qualified for this task than for building a bridge across the Amazon, but his reading of Paul Meehl’s work gave him a conceptual alternative to clinical impressionism. Meehl’s argument that simple statistical rules could outperform intuitive clinical judgments led him to suspect that the old interview allowed interviewers to pursue what interested them most: the dynamics of the recruit’s mental life, rather than concrete information about how the person had actually behaved in ordinary surroundings.
Design of the New Interview
The reform replaced a single global impression with six separately evaluated personality characteristics. The interviewer was to assess each trait independently and assign a score on a five-point scale. The selected dimensions included responsibility, sociability, and masculine pride, along with three other characteristics thought relevant to performance in a combat unit. The final combat-fitness score would be calculated from these ratings according to a standard formula, with no additional global judgment from the interviewer influencing the result.
The questions were designed to elicit observable facts about the recruit’s life before enlistment. Interviewers asked how many different jobs the recruit had held, how regular and punctual he had been at work or in his studies, how frequently he interacted with friends, and whether he showed interest in and participated in sports. The purpose was to estimate performance on each dimension as objectively as possible, rather than to infer a personality from the atmosphere of a brief conversation.
The fixed sequence of the interview was as important as the questions themselves. Interviewers moved through the six traits in the same order and rated one trait before proceeding to the next. This arrangement was intended to reduce the halo effect, in which a favorable first impression colors all later evaluations. The interviewers were told that they did not need to predict the recruit’s future military adjustment. Their job was to collect relevant facts from the past and provide reliable measurements; the predictive validity would belong to the formula that combined the separate scores.
The interviewers resisted the change because it seemed to demand that them suppress the very abilities they valued. Bright young people complained that the factual routine was boring and that the reform was turning them into robots. A compromise preserved a final intuitive exercise, but only after the standardized interview had been completed. Once the six traits had been scored, an interviewer could close her eyes, imagine the recruit as a soldier, and assign a separate overall score from one to five. Intuition was therefore not allowed to guide the evidence-gathering process, but it was not entirely excluded from the final assessment.
Results and the Role of Intuition
Several hundred interviews were conducted under the new method. A few months later, commanding officers supplied evaluations of the soldiers’ performance in the units to which they had been assigned. The reform produced a clear improvement: the sum of the six trait ratings predicted performance substantially better than the global evaluations generated by the earlier procedure. The result was not perfect prediction, but it moved the army from a method that was described as completely useless to one that was moderately useful.
The most revealing result came from the exercise that had initially seemed like a concession to the interviewers. Their intuitive judgments, made only after the factual questions and separate ratings, performed just as well as the combined six-trait score. This did not vindicate the old interview, because the old interview had allowed intuition to dominate from the beginning. Instead, it showed that intuition could add value after the interviewer had gathered structured information and evaluated distinct traits in a disciplined sequence.
The final formula reflected that finding by assigning the close-your-eyes evaluation the same weight as the sum of the six specific ratings. The reform thus embodied a careful middle position. It rejected the simple trust placed in unaided intuition, but it also rejected the opposite conclusion that intuition was worthless. The practical rule was to discipline intuition rather than obey or banish it.
Institutional Continuity and Broader Significance
The reform’s durability became visible roughly forty-five years later, after the designer had won a Nobel Prize in economics and briefly become a minor celebrity in Israel. During a visit, he was escorted around his former army base, where the same unit still interviewed new recruits. The commanding officer of the Psychological Unit described practices that had changed little from the system he had designed and reported that substantial research continued to show that the interviews worked well. At the end of the explanation, she added that the interviewers still instructed recruits to close their eyes.
The episode became a compact model for a larger argument about judgment. A prediction system improves when it decomposes a vague impression into measurable components, asks about behavior in the recruit’s normal environment, controls the order and format of evaluation, and combines judgments through an explicit rule. Yet the surviving intuitive exercise shows that standardization need not make human judgment mechanical. What matters is where intuition enters, what information precedes it, and whether it is allowed to override independently assessed evidence.
The reform also anticipates later behavioral-policy ideas associated with Richard Thaler and Cass Sunstein. Their work on choice architecture and libertarian paternalism likewise treats the structure of a decision as behaviorally consequential: defaults, presentation, and procedural demands can guide choices without removing the option to refuse. The military interview reform applies the same general insight to personnel selection. By changing the architecture of judgment, it reduced the influence of first impressions while retaining a bounded opportunity for experienced synthesis.
Its enduring significance lies in the tension it resolves. The system does not portray people as either perfectly rational Econs or helpless victims of bias. Interviewers possess useful pattern-recognition abilities, but those abilities are vulnerable when they operate before facts have been collected or when a global impression contaminates every subsequent rating. The Israeli Defense Forces reform therefore offers a durable institutional lesson: reliable judgment is often produced by making intuition wait, giving evidence a structure, and only then allowing an overall impression to speak.